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Abstract 

We investigate the continuity of the cj-functions and real functions defined by weighted 
finite automata (WFA). We concentrate on the case of average preserving WFA. We show 
that every continuous cj-function definable by some WFA can be defined by an average 
preserving WFA and then characterize minimal average preserving WFA whose a;-function 
or cij-function and real function are continuous. 

We obtain several algorithmic reductions for WFA-related decision problems. In particu- 
lar, we show that deciding whether the a;-function and real function of an average preserving 
WFA are both continuous is computationally equivalent to deciding stability of a set of ma- 
trices. 

We also present a method for constructing WFA that compute continuous real functions. 

Key words: continuity, decidability, matrix semigroup, stability, weighted finite 
automaton 
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1. Introduction 

Weighted finite automata (WFA) over M are finite automata with transitions labelled 
by real numbers. They can be viewed as devices to compute functions from words to 
real numbers, or even as a way to define real functions. Weighted finite automata and 
transducers have manynice applications in natural language processing, image manipulation 

etc, see 0, a a a ai a 

and references therein. On the other hand, weighted automata 
over more general semi-rings have been extensively studied as a natural extension of ordinary 
automata. A good source for more background information on various aspects of weighted 
automata is a forthcoming handbook on the field 
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WFA provide a natural and intrinsic description for some self-similar real functions. 
Smooth real functions defined by WFA are limited to polynomials However, many 

more functions in lower differentiability classes can be generated. In this paper, we study 
those WFA functions that are continuous. We have two concepts of continuity: the conti- 
nuity of the function /_4 that assigns real numbers to infinite words, and the continuity of 
the corresponding function /_4 that assigns values to points of the unit interval. 

Culik and Karhumaki have stated various results about real functions defined by the so 
called level automata in [lo|. In this work, we generalize many of these results to apply 
to the general setting. We also use the closely related theory of right-convergent product 
(RCP) sets of matrices as developed in 11, 12| and [isl]. 

The paper is organized as follows: In Section [2] we give basic definitions, introduce 
the concepts of stable sets and RCP sets of matrices, provide some key results on RCP 



sets from [ill . Il2l |. define weighted finite automata and discuss the important concepts of 
minimality and average preservation (ap). 

In Section [H] we study WFA as devices that assign real numbers to infinite words. We 
prove that any continuous function that can be defined by a WFA can, in fact, be defined 
using average preserving WFA, so restricting the attention to ap WFA is well motivated. 
We establish a canonical form for the average preserving WFA whose cj-function /_4 is 
continuous (Corollary [37j). We obtain algorithmic reductions between the decision problems 
of determining convergence and continuity of /_4, and the stability, product convergence and 
continuous product convergence of matrix sets. If stability of finite sets of square matrices 
is undecidable (which is not presently known) then all questions considered are undecidable 
as well. 

In Section H] we consider the real functions defined by WFA. Connections between the 
continuity of the cu-function and the corresponding real function are formulated. We specif- 
ically look into those ap WFA whose u- and real functions are both continuous. If the 
tu-function is continuous then there is a simple and effectively testable additional condition 
for the continuity of the corresponding real function. Again, we see that the stability of 
matrix products plays an important role in algorithmic questions. Finally, we provide a 
method to generate continuous ap WFA when a stable pair of matrices is given. 



2. Preliminaries 

Let S be a non-empty finite set. In this context, we call S an alphabet and its elements 
letters. With concatenation as the binary operation and the empty word e as the unit 
element, E generates the monoid E*, the elements of which are called words. 

We denote by |f | the length of the word f G S*. Denote the z-th letter of the word v by 
Vi and the factor fifi+i ■ ■ - Vj by By prefk{v) we denote the prefix of length k of the 

word V. An infinite word w is formally a mapping w : N —>■ H. Denote the set of all infinite 
words by S"^. 

The set S"^ is a metric space with the Cantor metric (or prefix metric) defined as follows: 

d (w w') = I if = 1^', 
I otherwise. 



where k is the length of the longest common prefix of w and w'. The space S'^ is a product 
of the compact spaces S, therefore S'^ itself is compact. 

The set of reals M is a complete metric space with the usual Euclidean metric 

dE^x, y) = \x — y\ for all x,y eM. 

We denote by E the unit matrix (of appropriate size). We use the same notation \\A\\ 
both for the usual P vector norm, if A is a vector, and for the corresponding matrix norm, 
if A is a matrix. 

Assume that for each letter a G S we have an n x square matrix Aa- Then for w G S* 
let Ay denote the matrix product A^^A^^ . . . A^^,. If v is empty, let A^ = E. If w G S"^, we 
let Aw = lim Aprefjw) if the limit exists. 

fc^oo 

In this paper, we assume that the elements of all matrices are defined in such a way that 
we can algorithmically perform precise operations of addition, multiplication and division as 
well as decide equality of two numbers. We can obtain such effective arithmetics by limiting 
ourselves, for example, to matrices and vectors with rational elements. 

Definition 1. Let B = {Aa | a G S} be a nonempty set of n x n matrices such that Ay^ = 
for every w G S*^. Then we call B a stable set. 

Given a finite set B of matrices, we will call the algorithmic question "Is B stable?" 
the Matrix Product Stability problem. For \B\ = 1, Matrix Product Stability is easy to 



solve using eigenvalues and Lyapunov equation (see page 169]). Moreover, there is a 
semi-algorithm that halts iff 5 is a stable set (idea of this algorithm is to check whether the 
joint spectral radius of B is less than 1, see [ll|). However, it is not known whether there 
exists an algorithm deciding Matrix Product Stability; even the binary {\B\ = 2) case is as 
hard as the general stability problem, see 15j and [iGj (we also prove this in Lemma 



The following Lemma is stated as Corollary 4.1a in [11[. For the sake of completeness 
we offer a short proof here. 

Lemma 2. Let {Aa | a G S} 6e a stable set of n x n matrices. Then the convergence of 
Aprefk{w) to zero is uniform. That is, for every e > there exists ko such that for any f G E* 
with \v\ > ko we have \\Ay\\ < e. 

Proof. Assume that the statement is not true. Then there is an £ > such that there exist 
arbitrarily long f G S* such that ||v4^,|| > e. From compactness of ly we obtain that there 
exists an infinite word u G S'^ with the property that for each I there exists a G S* such 
that ||y4uj^jpj| > e. But then 

II II AJI > ll^«[i,i]^f; II so 
II^.JI> 



A 



Because A^ = 0, we have that the set {||v4^|| \v G S*} is unbounded. In the rest of the 

proof, we use the reasoning from [l3| (proof of Lemma 1.1). 
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For each k, let v^''^ be a word of length at most k such that ||^i,(fc) || is maximal (note that 
yik) might be empty). Denote / = First, we show that ||^„(fc) || > 1 for all 1 < i < /. 

If for some such i we would have \\A (k) 11 < 1, then 

IIA,« IIIIA,('=) II > P,;{'=)ll> so 
IIA,(*=) II > IIA(fe)ll) 



contradicting the maximality of ||y4„{fc)||. We conclude that ||y4 (k) || > 1 for all i. 

As the norm of matrices is unbounded, the length of v^''^ goes to infinity. Then we 
obtain from the compactness of S"^ that there exists a word G S"^ such that for each 
i we can find ki such that ^[1^4] = v'^i'^y But this means that HA^^^^ .Jl > 1 for each i, a 
contradiction with the stability of {Aa \ a G S}. □ 

Definition 3. A set of matrices {Aa | a G S} is called right-convergent product set or RCP 
set if the function A^ : w ^ lim Apref^(w) is defined on the whole set T,'^. If A^ is continuous 

fc^oo 

on S'^, we say that the set is continuous RCP. 



Clearly every stable set is a continuous RCP set. In [llj, the authors prove several results 
about RCP sets of matrices. Most importantly. Theorem 4.2 from [llj (with errata from 
(1^ ) gives us a characterization of continuous RCP sets of matrices. For V, Ei subspaces of 
W such that R"" = V ® Ei denote by Py ■.MJ' ^ W the projection to V along Ei. 

Theorem 4 (Theorem 4.2 in lH). Let B = {Aa | a G S} he a finite set of n x n matrices. 



Then the following conditions are equivalent: 

(1) The set B is a continuous RCP set. 

(2) All matrices Aa in B have the same left 1-eigenspace Ei = Ei{Aa), and this eigenspace 
is simple for all Aa. There exists a vector space V with M" = Ei(BV , having the property 
that PyBPy is a stable set. 

(3) The same as (2), except that PyBPy is a stable set for all vector spaces V such that 
M" = Ei®V. 



From Theorem m and Lemma [2] follows a corollary (stated as Corollary 4.2a in . 
which generalizes Lemma [21 

Corollary 5. If B = {Aa \ a E Ti} is a continuous RCP set then all the products Apref^{w) 
for w G S'^ converge uniformly at a geometric rate. 

Another important result that we will need is part (a) of Theorem I in [l^, stated below 

(slightly modified) as Theorem [Ul A set of matrices B is called product-bounded if there exists 

a constant K such that the norms of all finite products of matrices from B are less than K. 

Notice that as all matrix norms on n x n matrices are equivalent, being product-bounded 

does not depend on our choice of matrix norm. 
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Theorem 6. Let B be an RCP set of matrices. Then B is product-bounded. 



So we have the foUowing sequence of imphcations: 

B stable =^ B continuous RCP =^ B RCP ^> B product bounded 



The problem of determining whether a given finite B is product bounded is undecidable [16[ , 
while it is not known whether it is decidable if B is stable, RCP or continuous RCP. We will 
explore the relationship between RCP sets and WFA later in the paper. 

Weighted Finite Automata 

A weighted finite automaton (WFA) ^ is a quintuple {Q, E, /, F, 6). Here Q is the state 
set, S a finite alphabet, / : Q — > M and F : Q W are the initial and final distributions, 
respectively, and 6 :QxJ]xQ^M. is the weight function. If 6{p, a,q) ^ for a G S, 
p,q & Q, we say that there is a transition from p to q labelled by a of weight S{p, a, q). We 
denote the cardinality of the state set by |Q| = n. Note that we allow Q to be empty. 

A more convenient representation of A is by vectors / G M^^", F G M"^^ and a collection 
of weight matrices G A^„xn(IR) defined by 

Va G S, Vi,j G Q : {Aa)ij = 6{i,a,j). 

A WFA A defines the word function F4 : S* ^ M by 

Fa{v) = IA,F. 

We denote by A^ the automaton which we get from the WFA A by substituting I Ay for 
the original initial distribution /. Obviously, = Fj^{vw) for all w G S*. 

Remark 7. Notice that for any n x n regular matrix M, we can take a new automaton 
with distributions IM, M~^F and the set of weight matrices {M~^AaM | a G S} without 
affecting the computed word function. We will call this operation changing the basis. 

This means that whenever /, F 7^ 0, we can change either J or F to any nonzero vector 
of our choice by switching to a different basis. 

Given a word function F, we can define u -function f on infinite words. For w G E'^, we 

let 

f{w) = lim F{prefk{w)), (1) 

fc— >oo 

if the limit exists. If the limit does not exist then f{w) remains undefined. In the following, 
we will use this construction to define cj-function /_4 using F4 for some A weighted finite 
automaton. 

As usual, the cj-function / : S"^ ^ M is continuous at i/; G S"^ if for every positive real 
number e there exists a positive real number 6 such that all w' in S"^ such that dc{w, w') < 6 
satisfy dE{f{w), f{w')) < e. In particular, if / is continuous at w then / must be defined in 
some neighborhood of w. We say that / is continuous if it is continuous at every G S'^. 

Thorough the paper, we will be mostly talking about the case when the convergence in 
the limit ([I]) is uniform: 



Definition 8. We say that a word function F is uniformly convergent if for every e > 0, 
there exists a ko such that for all w G S*^ and all k > ko we have 



\F{prefk{w)) - f{w)\ < e. 



A WFA A is uniformly convergent if F4 is uniformly convergent. 

Lemma 9. // a word function F is uniformly convergent then the corresponding u-function 
f is defined and continuous in the whole S'^. 

Proof. From the definition of uniform convergence we obtain that f{w) must exist for every 
w G S'^. Continuity follows from the fact that / is the uniform limit of continuous functions 
fk defined as fkiw) = F{prefk{w)) for all w G S'^. □ 

The following Lemma gives another formulation of the uniform convergence. 

Lemma 10. The function F is uniformly convergent iff for each e > there exists m such 
that for all w G S"^ and f G S* such that prefm{v) = prefm{w) we have 



Proof. Obviously, if F satisfies the condition on the right then letting ko = m and v = 
prefk{w) for k > ko yields that F is uniformly convergent. 

For the converse, assume e > is given. We need to find m with the required properties. 

If F is uniformly convergent then / is continuous by Lemma M and from the compactness 
of S'^ we obtain uniform continuity of /. So there exists / such that prefi{w) = prefi{z) 
implies I /(zf) — / (2;) I < e/2 for w, z E T,'^ . Let now /cq be such that |F(pre/A,.(z)) — /(2;)| <e/2 
for all z and all k > ko. Choose m > ko, I. Given v G S*, w G E'^ with prefmiy) = prefm{w), 
choose z G E'^ such that f is a prefix of z. Then we can write: 



In contrast to LemmaEj the following example shows that convergence to zero everywhere 
does not guarantee that a WFA converges uniformly. 

Example 11. Consider the automaton A on the alphabet E = {0, 1} described by Figure [H 
In the figure, the two numbers inside each state denote the initial and final distribution, re- 
spectively, while the numbers next to the arrow express the label and weight of the transition 
(weight is in parentheses). The matrix presentation of this automaton is 



F{v)-f{w)\<e. 



\F{v) - /HI < \Fiv) - f{z)\ + \f{z) - f{w)\ <U + \e = e, 



concluding the proof. 



□ 
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Figure 1: The automaton from Example II II 



This automaton computes the word function 

F (v) = l ^ 

10 otherwise, 

so it defines the zero cj-function. However, the convergence is not uniform at the point 
w = 0^. 

Definition 12. A WFA A with n states is said to be left minimal if 

dim(M„, M e S*) = n. (2) 

Similarly, A is called right minimal if 

dim(A„F, M e S*) = n. (3) 

If A is both left and right minimal, we call it minimal. 

In other words, A is minimal when each of its distributions generates the space M". Moreover, 
A is minimal according to our definition iff it is also minimal in the sense that no other WFA 
with fewer states than n can compute the same word function F4 (see [oj. Proposition 3.1). 
Observe that minimality is clearly invariant under the change of basis. 

Lemma 13. Given a WFA A, we can effectively find WFA A' such that A' is minimal and 
Fa' = Fa- 

For proof, see Proposition 3.1. Also, if the transition matrices of A had rational 
entries then we can choose A! so that its transition matrices have rational entries. In the 
following, we will often assume that A is minimal. 

Definition 14. A function F : S* M is average preserving (ap), if for all f G S*, 

^^-F(fa) = kF{v), where k = |S|. 

The WFA A with the final distribution F and weight matrices Aa is called average preserving 
(ap), if 

^AaF = kF, where k = 

uGS 
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Figure 2: Non ap automaton defining the zero w-function 



Every ap WFA defines an average preserving word function and every average preserving 
word function definable by some WFA can be defined by an ap WFA (see (3|, pages 306, 
310]). In fact, any minimal WFA computing an ap word function must be ap. Notice also 
that neither a change of basis nor minimizing (as in Lemma [T^ destroys the ap property of 
an ap automaton. 

Lemma 15. The only ap word function defining the zero u-function is the zero function. 

Proof. Assume that for every w G S'^ we have f{w) = 0, yet (without loss of generality) 
F{v) = s > for some word v G S*. By the ap property of F, we have: 

^5^F(H=F(t;). 

This means that ma.x{F{va) | a G S} > F{v) and so F{va) > s for some a. Repeating this 
argument, we obtain w G S'^ such that fji^{vw) > s > 0, a contradiction. □ 

Corollary 16. Let F, G be two ap functions defining the same uj-function f and suppose 
that f{w) is defined for every w G S'^. Then F = G. 

Proof. As the function F — G is ap and defines the zero cj-function. Lemma fT5l gives us that 
F - G = and so F = G. □ 

Example 17. As the only ap word function defining = is the zero function (Lemma 
[TH]) . it is easy to decide if a given minimal ap WFA A computes = 0. Such automaton 
is the unique zero state WFA (whose J, F are zero vectors from the space MP). However, in 
the non-ap case, we might encounter automata such as in Figure E) The automaton A has 
/ = F = (1) and Aq = Ai = (|). Obviously, A is minimal (but not ap) and computes the 
word function F^(t>) = 1/2^""^ and the a;-function = 0. 

3. Properties of cj-functions 

In this section, we will study the tu-function /_4, where A is an automaton operating on 
the alphabet S. We will put the emphasis on a;-functions defined using ap word functions, 
as these have numerous useful traits. 
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3.1. Average preserving word functions 

We begin by showing that any automaton computing a continuous cj-function can be 
modified to be ap and still compute the same cu-function. Hence we do not miss any WFA 
definable continuous functions if we restrict the attention to ap WFA. 

Actually, the following theorem is even more general and allows for some "defects" of 
continuity: we only expect to be uniformly continuous on a certain dense set A C E*^ 
(as usual, this means that the function may even be undefined outside A). 

We will need the more general formulation later in Section H] for Corollary EHl 

Theorem 18. Let A he a WFA and w G S"^. Suppose that is continuous on the set 
A = Tj*w, and suppose that there exists a continuous g : ^ such that fA\/^ = g\A- 
Then there is an average preserving WFA B such that Jb = g. Moreover, if A is left-minimal 
then B can he ohtained from A hy changing the final distrihution. 

Remark 19. The condition that "There exists a continuous (7 : S"^ ^ M such that fA\A — 
g\A" is equivalent with demanding that /^|^ be uniformly continuous. Moreover, if such a 
g exists then it is unique because A is dense in S"^. 

Proof. Using Lemma fT3l we can assume that the automaton A = {I,{Aa\a G A},F) is 
a left-minimal WFA. Denote by Ai the WFA obtained from A by replacing / by Jj, the 
2-th element of the canonical basis of M". Let us first prove that each /_4. is uniformly 
continuous on A. From left-minimality of A we obtain that there are words Mi, . . . , u„ G S* 
and coefficients ai, . . . ,an G M such that Fji^{v) = J2]=i(^j^A{ujv) for all v G S*. This 
implies that fA.i'^) = YTj=i^3fAiujv) for all w G A. But then /^^ is uniformly continuous 
on A as a linear combination of uniformly continuous functions v ^ fAi'^j'^)- 

Recall that w is the infinite word such that A = 'E*w. Observe that the limit G = 
lim {Apreff.{w)F) exists, as we have a simple formula for the i-th component of G: 

fc^oo 

Gi = lim {IiApref^,(w)F) = fA^w). 

k^oo 

Denote L = and let B = (/, {^a}; F") be the WFA with the modified final distribution 
F' = hm f ^"f G = lim }^ \reUu^)F. (4) 

^ / \u\=i 

First we show that the limit (jl]) exists. The j-th coordinate of the i-th vector in the sequence 
has the following presentation: 

^^^^ = 5Z l^iIjApreMuw)F) = J^,Y1 f^M^)- 
\u\=i \u\=i 

To show that lim 0^ exists, it suffices to show that is a Cauchy sequence as R is 

i— >oo 

a complete metric space. 
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Let e > 0. As /^^- is uniformly continuous on A, there is a such that prefk^{z) = 
prefk^z') imphes \f_^.{z) — < e for any z, z' G A. Let ^i"*^ and be two elements 

of the sequence with s > k^, t E N. Then 



L 



\u\=s+t 



|u|=s 



1 



|'ii|=S \ |t)|=t 



< 



m|=s \v\=t 

L'+'e = e. 



is+t 

We see that the vector sequence converges element-wise, and hence the limit 

exists. 

It remains to show that B is average preserving and verify the equality Jb = 9- To prove 
the ap property of B, we compute the product 



L lim 

i— >oo L 



L 



G 



L lim 
LF'. 



i+l 



G 



To show that = (?, let f G S"^ be an arbitrary word. Then 

fB{v)= hm IApref,{v)F' 



lim lAprefJv) lim ^ ^ lim y4pre/fc(M«,)^ 



I— >oo ^ k—KX 

\u\=i 



lim lim — lim IAprefJv)prefk{uw)F 

|ji|=j 



lim lim -^fA{prefj{v)uw) 

J— >oo«— >oo ' ij' 

lim lim \^ —g{prefj{v)uw) 



\u\=i 
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where the last equahty follows from the uniform continuity of g. 



□ 



Corollary 20. Every continuous function S'^ ^ M that can be computed by a weighted finite 
automaton can be computed by some average preserving weighted finite automaton. 

3.2. Continuity of uj -functions 

We now prove several results about WFA with continuous (X'-functions. While the behav- 
ior of general WFA with continuous tu-functions can be complicated, we can obtain useful 
results for uniformly convergent WFA and the uniform convergence assumption is well jus- 
tified: As we show in Lemma EH all ap WFA with continuous w-function are uniformly 
convergent. Together with Theorem [18] we then have that uniformly convergent WFA com- 
pute all WFA- computable continuous functions. 

Lemma 21. Let F be an ap word function. Let its u-function f be continuous. Then F is 
uniformly convergent. 

Proof. Let e > 0. By continuity of / and compactness of S"^, there exists an index k such 
that \f{w) — f{w')\ < e for every w,w' for which prefk{w') = prefk{w). Fix any w G S*^ 
and let f G S* be its prefix whose length is at least k. 
By the ap property of F, we obtain: 

^5^F(m)=F(.;). 

This means that 

ma.x{F{va) | a G S} > F{v) > min{F{va) \ a G S}. 

So for some letters a, 6 G E, we have F[va) > F{v) > F{vb). We can now continue 
in this manner, obtaining words Wi,W2 G S"^ such that f{vwi) > F{v) > f{vw2). By the 
choice of fc, we have f{w)+e > f{vwi) and f{vw2) > f{w)—e. Therefore, \f{w) — F{v)\ < e 
and the claim follows. □ 

Remark 22. While most of the theorems in this section deal with uniformly convergent 
functions and automata, uniform convergence is difficult to verify. The ap property of 
minimal automata, on the other hand, is easy to check. Thanks to Lemma EH we can 
rewrite all following theorems by replacing the uniform convergence assumption on F by the 
demand that F be ap and / be continuous. This is how we will mostly use the results of 
this section, as ap WFA are often used in applications. However, it turns out that uniform 
convergence is the essential feature that makes the following theorems valid, so we present 
the proofs in this more general setup. 

We now state a simple but important property of uniformly convergent word functions. 
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Lemma 23. Let F be a word function defining the uo-function f. If F is uniformly conver- 
gent, then the following equality holds for all w eT}^ and u E T,* : 

lim F{prefk{w)u) = f{w). 

fc^oo 

Proof. By Lemma [TUl for any 5 > there exists /cq such that for all /c > /cq we have 
\F{prefk{w)u) - f{w)\ < e. □ 

Example 24. Example [TT] shows that average preservation is a necessary condition in Lem- 
mas [21] and The WFA A in Figure [T] is minimal but not average preserving. It defines the 
(continuous) zero tu-function, but the convergence is not uniform. Likewise, the conclusion 
of Lemma [231 also does not hold for Fx- Choose w = 0'^ and u = 1. Then /(O"^) = while 
lim F(0'=1) = 1. 

fc— >oo 

Next, we show that changing the initial distribution of a left minimal WFA does not 
alter convergence and continuity properties: 

Lemma 25. Let A be a left minimal WFA and let B be a WFA obtained from A by changing 
the initial distribution. Then the following holds: 

(1) If f^ is defined on the whole S'^ then so is f^. 

(2) If fA is continuous then so is fs. 

(3) If A is uniformly convergent then so is B. 

Proof. Let us obtain B from A by changing the initial distribution to By the left minimal- 
ity of A, there are words Ui G S* and coefficients G M such that /' = aiIAu^ + . . .+anIAu„. 
Then B computes a function which is a linear combination of the functions F^m'- 

Fb{v) = aJA^^A^F + . . . + aJA^^A^F 
= aiF^iuiv) + . . . + anF^iunv) 

So, assuming that is defined everywhere, we obtain: 

ftsiw) = aifAiuiw) + . . . + anfAiunw), 

proving (1). Moreover, it is easy to observe (2) and (3) from these equalities. □ 

It follows from Lemma [25] that if f^ is a left minimal continuous WFA then the se- 
quence {Aprefk{w)F}'^^i of vectors converges element-wise as k tends to infinity: To see that 
{{Aprefi^(w)F)i}'^^i converges, we change the initial distribution to the i-th element of the 
canonical basis Jj = (0, . . . , 0, 1, 0, . . . , 0). Denote the resulting automaton by Ai. Then 
fAii'u^) is continuous and 

/a(«^) = {hApref^^^)F) = lim 

fe^oo ^ „ fe— >oo 



We see that lim Aprefk{w)F is the vector with i-th component equal to (w) for i = 1, . . . , n. 

fc— >oo 

We now look into the effect of changing the final distribution of a right minimal WFA. If 
the WFA is uniformly convergent then the outcome is the same as multiplying the a;-function 
by a constant. 

Lemma 26. Let A be right minimal and uniformly convergent. Then changing the final 
distribution of A keeps uniform convergence and affects by a multiplicative constant 
only. 

Proof. Let F' be any final distribution, and let Ui, . . . ,Un G S* be words such that F' = 
aiAu^F + . . . + anAu„F for some ai, . . . , an- Such words exist by the right minimality of 
A. Denote by B the WFA A with the final distribution F'. Then 

feiw) = lim {IApreff,(to)F') 

fc^oo 

= hm{IApref^,{w){aiAu^F + 

fc— >oo 

= «! hm {IApref,^^^)Au,F) + 
fc'^oo 

= («! + ...+ an)fA{w) 

where we have used Lemma [23] in the last equality. 

Uniform convergence of B easily follows, as the functions Fi{v) = Fj^{vUi) are all uni- 
formly convergent and Fq = Fi + F2 + ■ ■ ■ + Fn- □ 

Putting Lemmas and [22] together, we obtain a theorem about the continuity of u- 
functions. 

Theorem 27. Let A be a minimal uniformly convergent WFA. Then any automaton B ob- 
tained from A by changing I and F is also uniformly convergent (and therefore continuous). 

Proof. To prove the theorem, we change first / and then F. 

Lemma [25] tells us that changing I does not break uniform convergence of A. Also, it 
is easy to observe that changing I does not affect right-minimality of A, so the conditions 
of Lemma [23 are satisfied even after a change of initial distribution. Recall that uniform 
convergence implies continuity by Lemma [H] □ 

Recall that for w G S"^ we define A^ = lim^^oo ^prefk{w) if the limit exists. We are now 
prepared to prove that the weight matrices of a minimal uniformly convergent WFA form a 
continuous RCP set. 

Corollary 28. Let A be a minimal uniformly convergent WFA. Then the limit 

Aw = lilll Apref^.{w) 
fc— >oo 

exists for all w G S"^, the elements of the matrix A^ are continuous functions of w and we 
have fAi'w) = I^wF ■ 
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. . . + a„ lim {IApreh{w)Au^F) 

fc— >oo 



Proof. Taking = (0, . . . , 0, 1, 0, . . . , 0) and = (0, . . . , 0, 1, 0, . . . , 0)^ with one on the i-th 
and j-th place, we obtain the automaton Aij computing {Auj)ij. From Lemma ETJ we see 
that /^jj is continuous on the whole S, so elements of are continuous functions of S. 
Multiplications by constant vectors / and F are continuous operations so we can write 

fA{w) = lim IAj„.efk{w)F = / ( lim Aprefk(w)] F = lA^F, 

concluding the proof. □ 

Next we look into the matrices A^ and prove that they have some very particular prop- 
erties. 

Lemma 29. Let A be minimal and uniformly convergent, w E T,'^ and u E T,* . Then 

A A — A 

Proof. By Theorem [27] we can change the initial and final distributions of A to any / and 
F without affecting uniform convergence. Then Lemma [231 gives us that 

lA^AuF = J( hm Apref^^,^))AuF = lim {IApref,^^^)AuF) = lim {IApref^^^)F) = lA^F. 

k-^oo fe— »oo fc— >oo 

As the above equality holds for all / and F, we have 

AujAu = Anj. \3 

Corollary 30. Let A be minimal and uniformly convergent. If fj\_ is a non-zero function, 
then we can effectively find a vector Ic ^ such IcAa = Ic for all a E T, . 

Proof. Suppose 7^ 0. Then lAy^F 7^ for some w G S*^. Let Ic = lAw Consider now the 
WFA B obtained from A by replacing the initial distribution / with Ic. Then, by Lemma [29l 
we have for all m G S*: 

IcA^F = lA^AuF = lA^F = hF ^ 0. 

Thus B computes a non-zero constant function. 

Next we notice that for all w G S* and all a G S we have the equality IcAaA^F = IcF = 
IcA^F. This together with the right minimality of A gives us that IcAa = Ic for all a G E. 

We have shown that the matrices Aa, a G S always have a common left eigenvector 
belonging to the eigenvalue 1. We can find such common left eigenvector Ic effectively by 
solving the set of linear equations {Ic{Aa — E) = 0, a E S}. □ 

Remark 31. It is easy to see from Corollary [30] that any minimal and uniformly conver- 
gent WFA that computes a non-zero function can be made to compute a nonzero constant 
function just by changing its initial distribution to Ic- 

If A is uniformly convergent minimal WFA, then the rows of all limit matrices Ay^ are 
multiples of the same vector. 
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Lemma 32. Let A be minimal uniformly convergent WFA and let 7^ 0. Then for all 
w e E"^ the row space V{Aw) of A^, is one- dimensional. Moreover, V{Aiu) is the same for 
allw E S"^. 

Proof By Lemma [291 A^^uF = A^F and thus A^{AuF - F) = for all m G S*. We see 
that vector AuF — F is orthogonal to V{Aw) irrespective of the choice of u. 

Denote W = {A^F — F\F G S*). Now the minimality of A implies dimM^ > — 1, 
because dim(Vr + (F)) = n. On the other hand, for all w G S'^ we have V{Aw) C W-^ so 
dmvV{A^) < (XiraW^ < 1. If A^ = 0, for some w then fA{uw) = lAuA^^F = for all 
M G S* and so, by continuity of we would have = 0. This means that diml^(y4^) = 1 
and V{A^) = for all w. □ 

Remark 33. From Lemma [32] it follows that the vector 1^ from Corollary [30] belongs to 
V{Aw) and is therefore unique up to multiplication by a scalar. 

Remark 34. Let A be minimal and uniformly convergent. If F is an eigenvector belonging 
to the eigenvalue A of some Au, then for all w E 12'^ 



Using Corollary [30] and Lemma [32], we can transform all minimal uniformly convergent 
automata to a "canonical form". This transformation is a simple change of basis, so it 
preserves minimality as well as the the ap property: 

Lemma 35. Let A be a minimal uniformly convergent automaton such that /^t 7^ 0. Then 
we can algorithmically find a basis of such that the matrices Aa are all of the form 



where {Ba \ a eT,} is a stable set of matrices. 

Proof. Suppose that A is minimal and uniformly convergent. Using Corollary [SHI we can 
algorithmically find a vector 1^ such that IcAa = Ic for all a G S. Let us change the basis of 
the original automaton so that Ic = (0, . . . , 0, 1) (this does not affect uniform convergence 
or minimality of A). 

As we have IcAa = Ic, the lowest row of every weight matrix Aa must be equal to 
(0, . . . , 0, 1). In other words, we have shown that for every a G S, matrix Aa has the form 



where and are row and column vectors, respectively. For v word (finite or infinite), 
denote 



A^F = A^AuF = A^XF = XA^F, 



and thus either A = 1 or A^F = for all w E Tj^. In the latter case /^^ = 0. 




(5) 





From the formula for matrix multiplication, we obtain 



An, 







• 


(B, 




-{ 


\ 




K 











V 


1 ; 



in particular Bu^ = B^B^, and so B^j is simply a product B^j-^B^j.^ 
For all w G S'^, we have: 

A,,, 



B„ . 



(B^ 









By Lemma [32l we know that if A defines a continuous function, then the rows 1, . . . , n — 1 
in Aw are multiples of row n. This means that B^, = for all w G S'^ and so {Ba | a G S} 
is a stable set. □ 

One might ask if all automata with matrices of the form and {Ba | a G S} stable 
are uniformly convergent. We show that the answer is yes and prove an even more general 
statement along the way (we are going to need this more general form later when proving 
Theorem [61)1 . 



Lemma 36. Let {Aa | a G S} be a finite set of matrices of the form 

A„, 



[Ba 


Ca\ 




Da) 



where Ba and Da are square matrices and the set {Ba \ a & T,} is stable. Then the following 
holds: 

(1) If {Da I a G S} is product-bounded then {Aa | a G S} is product-bounded. 

(2) If {Da\ae S} IS RCP then {AJ a G S} is RCP. 

(3) If {Da I a G S} is continuous RCP then {Aa | a G S} is continuous RCP. 

(4) If {Da I a G S} is stable then {Aa | a G S} is stable. 



Proof. As before, denote 



A: 



(B, 


CA 




Dj 



It is easy to see that B^j and D^j are equal to the matrix products B^^B^^^ . . . B^^ and 
Dy-^Dy^ . . . Dy^, r e sp ec 1 1 vc ty, while for Cy the equality C„„ = B^Cy + C^Dy holds. 

(1) Let be a constant such that ||-Dm|| < K for all u G S*. We need to prove that there 
exists a constant L such that ||C„|| < L for all m G S*. 

By Lemma O there exists a k such that for all words u of length at least k we have 
< 1/2. Denote M = max{||5„|| | u G S*, \u\ < k} and N = max{||C„|| | a G E}. 
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Let m = \u\. It is easy to see that when m > k, the inequahty \\Bu\\ < M ■ 2 ^"^/'^i 
holds. Moreover, a quick proof by induction yields that: 

m 

Hence, we can write (for m > k): 

fc-1 

II II ^ ^ ^ II II II II II -D^^^j^ ...^yjj II ~l~ 

j=0 

m 

~^ ^ ^ ||-S?il---Mj„l II II C'ttj II ll-Dji^.^j^.-.tj^ II 

j=k 

k—1 m 

< ^ MNK + ^ M ■ 2-^1^^ ■ NK 

j=0 j=k 

The first sum is exactly kMNK while the second one can bounded from the above by 
kMNK. All in all, we obtain that ||C„|| < 2kMNK and so {Aa | a G S} is product- 
bounded. 

(2) Using Theorem [HI we obtain that the set {Da | a G S} is product-bounded. Therefore, 
using the part (1) of this Lemma, we see that {Aa | a G S} is product-bounded and so 
there exists some L > such that ||C„|| < L for all u G S*. 

We only need to show that for every w G S'^, the sequence {Cpre/fe(«))}fcli satisfies the 
Bolzano- Cauchy condition. 

Assume e > is given. Because {Ba | a G S} is stable, there exists a k such that 
||-Bpre/s,(t«)|| < ^K^L). Denote u = prefkiw) and let x G S'^ be such that w = ux. The 
sequence {-Dpre/i(x)}i^i converges so there exists a number j such that for all positive i 
we have ||-Dpre/ (i) — -Dpre/ +i(x)|| < ^/{'^L). Let v = prefj{x) and write w = uvy where 
y is an appropriate infinite suffix. 

We will now prove that for all prefixes uvs of w we have \\Cuv — Cuvs\\ < Using the 
equalities 

we obtain 

£ £ 

\\Cuv ~ Cufsll ^ ||-^«|| ll^ti ~ ^vs II + ||C*u|| ll-D,^ — Dyg II < ■ 2L + L ■ -^j- = £, 

this means that the sequence {Cprefkiw)}'kLi Cauchy and so the proof is finished. 
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(3) By case (2) we have that A^j exists for all w G S"^. As B^, depend continuously on 
w, all we need to show is that the map w i-^ is also continuous. 

As before, by Theorem [6] the set {Ca | a G S} is product-bounded. By passing to limits, 
we see that there exists L such that ||Cu,|| < L for all infinite w eT!^ . 

The function w ^ is continuous on a compact space and so it is uniformly contin- 
uous. Given e > 0, we find k such that for all u, v of length k and all w,z E we 
have: 

llflj < ^ 

e 



2L 



We can now, similarly to case (2), write: 



I CuvZ CuvW II ^ II 1 1 1 1 C^z Cyyi] 1 1 ~l" 1 1 Cu 1 1 1 1 D 



VW 



e e 



proving continuity. 



(4) Using case (2), we obtain that Cz exists for all z E T!^ and moreover, by Theorem [HI 
there exists L > such that HC^H < L for all 2; G S"^. 

Let w G S'^ and e > 0. If we prove that ||C^|| < £, we are done. There is a finite prefix 
M of w such that ||-Bm|| < e/L. Let w = uz, where word 2; G S"^ is the remaining infinite 
suffix of w. We now have: 

IIC.II = ||a.|| = m.C^ + C.M\ = WBuCzW < \\B.M\C.\\ <jL = e, 

where we have used the equality Dz = 0. This means that ||Cu;|| = and we are 
done. □ 

Observe that by letting Da = 1 for all a G S, we obtain from case (3) of Lemma [HUl and 
Corollary E] a partial converse to Lemma ESI AH automata of the form with {Ba | a G S} 
stable are uniformly convergent. 

Therefore, putting Lemmas [35] and [36] together, we obtain (under the assumption that 
A is minimal and 7^ 0) a characterization of uniformly convergent automata. 

Corollary 37. Let A be a minimal automaton such that 7^ 0. Then A is uniformly 
convergent iff' there exists a basis of in which all the transition matrices Aa have the 
form ^ where {Ba | a G E} is a stable set. 

Note that we could have relied on Theorem [1] here: Together with Lemma WJi it directly 

gives us Corollary [37] (We only need to realize that the dimension of the space Ei is 

one in this case, which follows from Lemma [321) However, we wanted to show how to 

algorithmically obtain the form ([5]) and we will also need Lemma [36] later on. 
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Remark 38. If ^ is a minimal ap automaton then it is easy to verify algorithmically 
whether = 0, because = iff F4 = 0. 



Remark 39. In [10[, the authors define level automata as automata satisfying the following 
conditions: 

(1) Only loops of length one (i.e. q ^ q) are allowed. 

(2) The transition matrices and distribution vectors are non-negative. 

(3) For every state p, if there exist a state q ^ p and a letter a such that (^a)p,q 7^ then 
{.^a)p,q < 1 for all q and a. If there are no such q and a then (Aa)p,p = 1 for all letters a. 

(4) The automaton is reduced; it does not have useless states. 

As all level automata have (after proper ordering of states) matrices of the form 



(Ba 









where E is the unit matrix and Ba are upper triangular matrices with entries in the inter- 
val [0,1), the automata from case (3) of Lemma [HUl are actually a generalization of level 
automata. 

3.3. WFA and RCP sets 

In this part we explicitly connect the notions of RCP sets and functions computed by 
WFA. 

Theorem 40. Let A he a WFA and let B = {Aa \ a E T,} he its set of transition matrices. 
Then the following holds: 

(1) If B is an RCP set then is defined everywhere. 

(2) If B is a continuous RCP set then A is uniformly convergent (and therefore is 
continuous) . 

For the converse, we need to assume minimality: 

3. If A is uniformly convergent and minimal then B is a continuous RCP set. 
Proof. (1) If the limit A^ = \imk~*oo Apref^{w) exists then 

/^(w) = lim Fji,{prefk{w)) = lAy^F. 

As Aw is defined everywhere, so is /y^. 
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(2) Similarly to the first proof, we have fA{w) = lAy^F where w ^— is a continuous 
function, so w ^— fA{w) is continuous. Uniform convergence follows from Corollary [5], 
continuity from Lemma [9l 

(3) This is precisely Corollary [281 D 

The uniform convergence and minimality conditions in the third statement are both 
necessary, as we can see from the following two examples where is continuous but A is 
not even RCP: 

Example 41. We construct a counterexample that is ap (and thus uniformly convergent 
by Lemma [2T|) but not minimal. Let / = (0, 1), F = (0, 1)"^ and 

^° = ^^=(o 1 

This automaton is ap and computes the constant function fA{ui) = 1, yet the set {Aq, Ai} 
is not RCP. 

Example 42. To obtain a minimal automaton that computes a continuous function, but 
does not have RCP set of transition matrices, take the automaton A from Example [TTl This 
automation computes the zero tu-function and has transition matrices 

. _ /-I 0\ . _ fO 1 
^^" 



Now observe that 



so A is not RCP. 



/in 
^0 



(-1)" 




The next example shows that even if A is minimal and ap, and if Ja is everywhere defined 
and continuous everywhere except at one point, we can not infer that A is RCP. 

Example 43. Let J = (1, 0), F = (0, 1)^ and 

/^-i 0\ , fO A A -1 



It is easy to see that A is both ap and minimal. Moreover, we have 

F(0") = = 

F(0"lw;) = (-1)" 
F(0"2w;) = (-1)"+^ 

for every G S*. This means that J'a is defined everywhere. However, Ja is not continuous 
at 0'^. The set A is not RCP, because we have 



An 
^0 



(-1)" 
1 
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3.4- Decision problems for u -functions 

In this part, we present several results about decidability of various properties of the 
tu-function fj^ in the case of ap automata. In particular, we are interested to know how to 
determine if the a;-function fjs, is everywhere defined, or everywhere continuous. It turns 
out that the questions are closely related to the decidability status of the matrix stability 
problem: If it is undecidable whether a given finite set of matrices is stable then it is also 
undecidable for a given ap WFA A whether /_4 is everywhere defined, or whether /_4 is 
continuous. We also show that in this case it is undecidable if a given finite matrix set is 
RCP, or if it is continuous RCP. Conversely, if it were the case that stability is decidable then 
continuity of is decidable, as is the question of whether a given matrix set is continuous 
RCP. The central algorithmic problem is therefore the following: 

Matrix Product Stability: 

Input: A finite set {Aa | a G S} of n x n matrices. 
Question: Is {Aa | a G S} stable? 

We begin with the equivalence problem of two ap WFA. 

Theorem 44. Given two ap WFA A and B such that at least one of the uo-functions 
and fig is everywhere defined, one can algorithmically decide whether fA = fi3- 

Proof. To decide fj_ = /g, we construct ap automaton C computing the difference — fe 
and then minimize C, obtaining some automaton V. Minimization is effective by Lemma [T3l 
Now from Lemma [T^l we get that — //^ = iff P is the trivial automaton. Note that 
fA ~ fis is not defined on those w G S'^ for which exactly one of the functions /_4 and is 
undefined. Hence /^^ — /b = is equivalent to f_A = fs- D 

Note that the process in the previous proof fails if = is not everywhere defined: 
in this case also — will be undefined for some w G S"^, yielding (wrongly) a negative 
answer. 

In contrast to Theorem HH if MATRIX PRODUCT STABILITY is undecidable then the 
analogous question is undecidable without the ap assumption. In this case one cannot even 
determine if a given non-ap WFA defines the zero-function. 

Theorem 45. Matrix Product Stability is algorithmically reducible to the problem of 
determining if f^, = ^ for a given WFA A. 

Proof. Given a set of matrices B = {Aa \ a G S}, we construct automata Aij with transition 
matrices Aa, initial distribution Jj and final distribution Ij (where Ji, . . . is a basis of 
M"). Obviously, B is stable iff all the cj-functions computed by Aij are zero. □ 

We conjecture that Theorem HS] holds even under the additional assumption that f_A is 
known to be everywhere defined and continuous, but we can not offer a proof. 

Recall that Theorem [18] tells us that for every WFA computing a continuous function 
there is an ap WFA that computes the same function. It would be interesting to know 
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whether this conversion can be done effectively. One consequence of Theorems HH and HS] is 
that, assuming Matrix Product Stability is undecidable, we cannot effectively convert 
a non-ap WFA into an ap WFA with the same cj-function. 

In the following we reduce Matrix Product Stability to the following decision 
problems: 

Ap-WFA CONVERGENCE: 

Input: An average preserving WFA A. 
Question: Is f_A everywhere defined? 

Ap-WFA CONTINUITY: 

Input: An average preserving WFA A. 
Question: Is f_A everywhere continuous? 

Matrix Product Convergence: 

Input: A finite set {Aa | a G S} of n x n matrices. 
Question: Is {Aa | a G S} an RCP set? 

Matrix Product Continuity: 

Input: A finite set {Aa | a G S} of n x n matrices. 
Question: Is {Aa | a G S} a continuous RCP set? 

To simplify our constructions, we use the fact that the problems MATRIX PRODUCT 
Stability, Matrix Product Convergence and Matrix Product Continuity are 
as hard for a pair of matrices as they are for any finite number of matrices, see [15l|. The 
elementary proof for MATRIX PRODUCT STABILITY we present is based on [16 . 



Lemma 46. The Matrix Product Stability problem for a set {Ai, A2, . . . , Am} of 

matrices, is algorithmically reducible to MATRIX PRODUCT STABILITY for a pair of matrices 
{Bo,Bi}. 



Proof. For given m matrices Ai,A2,. 
mn X mn that in the block form are 



Arr, of size n X n we construct two matrices of size 



Ba 






Bm{n~l) 











( 


.. 


• o\ 


Bi = 








\ Am 


.. 


• 0/ 



Here Em{n-i) is the m{n — 1) x m{n — 1) identity matrix, and indicates the zero matrix of 
appropriate size. 

In the same way that we produce graphs of WFA, we construct the graph in Figure [3l 
(We are actually constructing a WFA over the ring of n x n matrices.) 

Consider now the matrix where v G {0, 1}*. This matrix can be divided into m x m 

blocks of size n x n. To calculate the value of the block at the position z, j, we add up all 

the products along all paths labeled by v from vertex i to vertex j. Due to the shape of the 
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{E) 



{E) 



1 {AA 




V 



{E) 



(E) 



Figure 3: Directed graph whose paths correspond to blocks in the products of Bq and Bi in the proof of 



graph in Figure [3l there will be always at most one such path for each i,j,v and each 
will have at most m nonzero n x n blocks. 

Moreover, it is easy to see that the blocks in infinite products are exactly all the infinite 
products of matrices Ai (or zero matrices), so it is clear that {Bq,Bi} is stable if and only 



Theorem 47. Matrix Product Stability is algorithmically reducible to problems Ap- 
wfa convergence, ap-wfa continuity, matrix product convergence and 
Matrix Product Continuity 

Proof. Let B = {Ba | a G S} be a set of matrices whose stability we want to decide. Thanks 
to Lemma HHl we can assume S = {0, 1}. 

We create several ap-automata Aij such that: 

• if 5 is stable then the function /_4jj- is continuous and the matrices of Aij form a 
continuous RCP set for each i,j, while 

• if 5 is not stable then for some i,j the function f^^j is not everywhere defined and 
the transition matrices of Aij are not an RCP set. 

The result then follows directly. 

We choose the transition matrices for An as follows: 



Lemma 1461 



if {Ai, A2, . . . , Am} is stable. 



□ 




Here the column vectors boj and hij have all entries zero except for the j-th. The j-th 
entry of boj is 1 while the j-th entry of bij is —1. 

The initial distribution of Aij is Jj = (0, . . . , 0, 1, 0, . . . , 0) with one on the i-th place. 
The final distribution is the same for all automata: F = (0, . . . , 0, 1)"^. 

First observe that 



(Bo + Bi 




V 













so each Aij is ap. If i? is a stable set then from the case (3) of Lemma [361 we obtain that for 
all z, j the set {Aa | a G S} is a continuous RCP set, and therefore all /^j^ are continuous. 
Assume then that B is not stable, so for some w the limit lim Bpref^iw) is not zero or 

does not exist. Then there exists a pair such that the sequence < (^Bpref,.(w)),i^j\ 

does not converge to zero. Consider the value of Fji,..{prefk{w)). The product of transition 
matrices will be 



( Bprefk{w) 




V 





Aprefkiw) 

where b^ is some column vector. The value of F_A^^{prefk{w)) is equal to IiApref,,{w)F , which, 
after a short calculation, turns out to be the i-th element of b^. 

Moreover, it is straightforward to verify that the vectors b^ satisfy the equation b^+i = 
hk+Bprefk{w)^Wk+i,j- Taking the i-th. element of b^+i, we get the equation for Fj^^^. {prefkiw)): 

FA.,{prefk+i{w)) = F^^^iprefkiw)) + c^,^^ {BpreMw))^^ , 

where c^j.^^ is the j-th element of b^^.^^^-, i.e. either 1 or —1. We obtain 

\FA^,{prefk+i{w)) - FA,^{prefk{w)) \ = {Bpref^^^)) 

Because the sequence < (i?pre/fc(to)) ^ • \ does not tend to zero, neither does the difference 
\FA,j{prefk+i{w)) - FA,^{prefkiw))\. But then the sequence of values {F^ij(pre/fc(w))}^i 



does not satisfy the Bolzano- Cauchy condition and can not converge. Therefore, fAij{w) 
remains undefined. 

By Theorem HQ] the matrices of Aij are then not an RCP set, which concludes the 
proof. □ 

Remark 48. Note that the proof showed, in fact, more: if Matrix Product Stability 

is undecidable then the continuous ap WFA are recursively inseparable from the ap WFA 

that are not everywhere defined. Recall that two disjoint sets A, B are called recursively 

inseparable if there does not exist an algorithm that on input x returns value if a; G v4, 

value 1 if X G -B and may return either value ii x ^ AU B. If membership in either A 
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or B is decidable then clearly A and B are not recursively inseparable, but the converse is 
not true. The reduction in the previous proof always produced ap WFA whose a;-function 
is either everywhere continuous, or not everywhere defined, so the recursive inseparability 
follows directly. 

Analogously, the proof shows that if Matrix Product Stability is undecidable then 
one cannot recursively separate those finite matrix sets that are continuously RCP from 
those that are not RCP. 

Next we consider the implications if Matrix Product Stability turns out to be 
decidable. 

Theorem 49. Problems Ap-WFA continuity and Matrix Product Continuity are 
algorithmically reducible to MATRIX PRODUCT STABILITY. 

Proof. The reduction from MATRIX PRODUCT CONTINUITY to MATRIX Product Sta- 



bility was proved in Let us prove the reduction from Ap-WFA continuity, so let 
v4 be a given ap automaton whose continuity we want to determine. 

We begin by minimizing A. If the resulting automaton computes the zero function, 
we are done. Otherwise, we run the procedure from Lemma [35] to obtain the form ([5]) of 
transition matrices. If any step of the algorithm fails (that is, nontrivial Ic does not exist), 
A can not define a continuous function. Otherwise, is continuous iff {Ba | a G E} in ([5]) 
is stable. □ 

From Theorems 1471 and l49l we conclude that decision problems Matrix Product Sta- 
bility, Ap-WFA continuity and Matrix Product Continuity are computationally 
equivalent. 

If we drop the requirement that the WFA is ap, we can make the following observation: 

Theorem 50. Matrix Product Convergence is algorithmically reducible to the prob- 
lem of determining if a given WFA is everywhere defined. 

Proof. Use the same reduction as in the proof of Theorem H^l n 



4. Real functions defined by WFA 

Let S = {0, 1} be the binary alphabet and A a WFA over S. Then we can use to 
define the real function /_4 : [0, 1) ^ R via the binary addressing scheme on the half-open 
interval [0, 1). For w G S*^ denote by num{w) the real number 

oo 

num{w) = ^^Wi2~\ 

i=l 

Let = S"^ \ S*!"^. It is easy to see that by taking num\Q, we obtain a one-to-one corre- 
spondence between words of Q and numbers in the interval [0, 1). Denote bin the inverse 
mapping to num\Q, i.e. 



Vw G Q, bin{x) = w <^=^ num{w) = x. 
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Figure 4: Automaton from Example ISTl 



We emphasize that the correspondence is between sets [0, 1) and Q, not [0, 1) and E'^. A 
point X G [0, 1) with a word presentation of the form bin{x) = vO'^ for some f G E* is called 
dyadic. Points without such a presentation are non-dyadic. 

Let / be a (partial) function from S'^ to M. Then we define the corresponding (partial) 
real function / : [0, 1) M by: 

f(x) = f{bin{x)). 
As usual, if f{hin{x)) is not defined then f{x) remains undefined. 

4.1. Continuity of real functions defined by WFA 

We will call the real function / continuous resp. uniformly continuous if it is continuous 
resp. uniformly continuous in the whole [0, 1). Note that / is uniformly continuous iff it can 
be extended to a continuous function on the whole closed interval [0, 1]. 

The following two examples show that the function /_4 can be continuous without being 
uniformly continuous: in these examples the left limit lim /^(x) does not exist. 

X— >1_ 

Example 51. The ap WFA in Figure H] computes a piecewise linear function /_4 : [0, 1) — M 
that does not have the left limit at point 1 (see its graph in Figure Ej). The cj-function /_4 is 
everywhere defined, but the convergence at point 1*^ is not uniform. Note that /yt(l'^) = 1/2. 
Function /_4 is continuous at all points except 1*^. 

Example 52. The ap WFA in Figure [6] computes a piecewise linear function that maps 
1 — 1/2" 2" — 1 for n G N. See the graph in Figure [71 Obviously, lim f{x) = oo. The 

cj-function is not defined at point 1*^. 

The following Lemma establishes correspondence between the continuity of the real func- 
tion / and the corresponding a;-function / in its relevant domain Q. Continuity of / in 
corresponds to the continuity of / at all non-dyadic points together with continuity of / 
from the right at all dyadic points. 
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1 
Figure 5: Graph from Example 1511 




Figure 6: Automaton from Example 1521 
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Figure 7: Graph from Example [ 



Lemma 53. Let f be any uj -function, and let f be the corresponding real function. Let 
X G [0,1) and denote w = bin{x). Function f is continuous at w as a function Q ^ M. 
if and only if f is continuous (continuous from the right) at the point x, provided x is 
non-dyadic (dyadic, respectively) . 

Proof. Let us show first that for u,v G S'^, we have the inequality between the Euclidean 
and Cantor metrics 

dE{num{u),num{y)) < dc{u,v). 
Let dc{u,v) = Then Ui = Vi for all 1 < i < j. Therefore 



dE{num{u) , num{v)) 



oo 



Ui - Vi)2~ 

i=l 

oo 

< \{u,~Vi)\2 
i=j+i 



i=j+i 



< 



- Vi)2-' 
dc{u,v). 



We have obtained for all m, f G S'^ the implication 

dc{u,v) < 6 =^ dE{num{u),num{y)) < 5, 

so it follows directly that the continuity of / at num{w) implies the continuity of / at w G ^2. 

Suppose now that num{w) is dyadic. Then w = vO'^ for some finite word v of length k. We 
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have 

dc{u,w) < 2^^ =^ num{u) > num{w), 

so in this case continuity of / at num{w) from the right is enough to obtain the continuity 
of / at w. 

Let us prove the converse direction. Suppose that / is continuous a,t w E Vl. For 
every k there exists 5 > such that whenever num{w) < num{v) < num{w) + 6, then 
prefkiw) = prefk{v). We can accomphsh this by choosing 6 = num{prefk{w)V^) — num{w) . 

Similarly, if w does not end in 0"^ (i.e. num{w) is not dyadic), we can choose 6 = 
num{w) — num{prefk{w)0'^) and see that num{w) — 5 < num{v) < num{w) implies 
prefkiw) = prefkiv). 

This means that for every e > there exists 5 > such that 

dE{num{u) , num{w)) < 6 (and num{u) > num{w) if num{w) is dyadic) =^ dc{u,w) < e. 

This is enough to see that / is continuous at x = nuni{w) if x is not dyadic, and continuous 
from right if x is dyadic. □ 

The following example shows that Lemma ESI can not be extended to continuity from the 
left at dyadic points. 

Example 54. Let ^ be a WFA with 

It is easy to see that fj^(lv) = 1 and /^^(Of ) = for all v G S'^. Clearly, /_4 is continuous: 
For each w,w' e S'^, dc{w,w') < 1 implies dE{fA{w), f_A.{w')) = 0. However, is not 
continuous at the point x = 1/2, as /^(l/2) = 1, but /^(|/) = for any y < 1/2. 

Based on Lemma ESI we can now characterize those real functions / whose corresponding 
cj-function / is continuous or uniformly continuous in Q. 

Corollary 55. Let f be an uj-function and let f be the corresponding real function. Then: 

(1) Function f is continuous in the set Q if and only if f is continuous at every non-dyadic 
point and continuous from the right at every dyadic point. 

(2) Function f is uniformly continuous in the set Vl if and only if f is continuous at every 
non- dyadic point, continuous from the right at every dyadic point, and has a limit from 
the left at all nonzero dyadic points as well as at the point x = 1. 

Note that f might not even be defined at points in S*l'^. 
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Proof. Part (1) follows directly from Lemma [53l so we focus on part (2). 

Suppose that / is uniformly continuous in Q. By part (1) it is sufficient to show that 
/ has a limit from the left at each point num{vl^) for v G S*. As Q is dense in E"^, there 
exists a (unique) continuous (7 : S*^ — > M such that g\Q = f\Q. Then 

lim f{x) = Mm f{w) = Mm g{w) = g{vl'^), 

x— >num(i;l")_ iii-n>l" w^vl'^ 

SO the limit exists. 

For the other direction of (2), assume that / has a limit from the left at all dyadic points, 
including 1. By (1) we have that / is continuous in Q. We need to prove that / is uniformly 
continuous in Q. We show this by constructing a continuous g : T,'^ —>-M such that g\n = f\Q.- 
Uniform continuity of / then follows from the compactness of T!^ . For every vV^ , set 

g{vV^) = lim f{x) = lim f{w), 

x^numivl'^)- m^t)l" 
^ ' -wen 

while for w & Q we let g{w) = f{w). Because the limit from the left exists at every 
num{vl'^) , the function g is everywhere defined. It remains to verify that g is continuous in 

Let f G S"^ and e > 0. From the definition of g and properties of / we obtain that there 
exists S > such that 

Vm G Q,dciv,u) <6 ^ \g{v) - g{u)\ < ^e. 

Now whenever u = zV^ and dc{v,u) < 6, the value g{u) is the limit of the sequence 
{g{zl"-0'^)}'^^i whose elements belong to Q. Observe that for all n large enough we have 
dciv, zl"0^) < 6 and so \g{v) - ^(^l^O"^)] < e/2. Therefore, \g{v) - g{u)\ < e. 

We have shown for all u that if dc{v., u) < 5 then \g{v) —g{u) \ < e, proving continuity. □ 

Remark 56. By (2) of Corollary [55], uniform continuity of / in f2 implies the existence 
of lim f{x). So in this case, if / is continuous it is uniformly continuous. In particular, 

continuity of / in S"^ and / in [0, 1) imply uniform continuity of /. 

Uniform continuity of / is stronger than uniform continuity of /. The additional require- 
ment is the continuity of / from the left at all dyadic points: 

Corollary 57. The function f : [0, 1) — > M obtained from the uj-function f is uniformly 
continuous if and only if: 

(1) Function f is uniformly continuous in VL, and 

(2) for all finite words v, the equality g{vl{i^) = g{v01'^) holds, where g is the (unique) 
continuous function : S"^ — R such that f\Q = g\Q. 
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Proof. If / is uniformly continuous in [0, 1) then it has a right hmit at x = 1, so / satisfies 
the conditions in part (2) of Corollary [551 Therefore, / is uniformly continuous in Q. Let g 
be the continuous extension of / to S'^. Because g is continuous at dyadic points, we have 

g{vW^)= lim g{w)=g{vOr). 

to— »d01" 

Assume now that conditions (1) and (2) hold. 

Using Lemma [53l we obtain continuity of / at non-dyadic points and continuity from 
the right at dyadic points. Now continuity of / from the left at dyadic points follows from 
(2) and the continuity of g. 

We also have lim /(x) = so we can continuously extend / to the whole interval 

[0, 1], proving uniform continuity of /. □ 

If /_4 is uniformly continuous then we know that / is uniformly continuous in Q. Because 
E*0'^ C f2 we can choose w = 0'^ and A = T,*0^ in Theorem [18] and obtain an average 
preserving WFA computing /. 

Corollary 58. // a uniformly continuous function /_4 is computed by some WFA A, then 
there is an average preserving WFA B such that f^s, = fs o,nd fs is continuous in S"^. 
Automaton B can be produced from A by first minimizing A and then changing the final 
distribution. 

Note that B itself need not be right-minimal but we can minimize it. Putting together 
the Corollary [SH] and Lemma [HSl we obtain the main result of this section: 

Corollary 59. // a nonzero uniformly continuous function f is computed by some WFA A 
then f is also computed by a minimal, average preserving WFA with transition matrices of 
the form 



A: 





where i = 0, 1 and {Bq^ Bi} is a stable set of matrices. 

4.2. Decision problems concerning the real function continuity 

In this section we study how does the decision problem Matrix Product Stability 
relate to the problem of deciding the uniform continuity of the real function determined by 
a WFA. 

Note that we do not address non-uniform continuity of f_A for which Corollary [59] fails. 
On the other hand, by Corollary [58] any uniformly continuous is generated by an ap 
WFA with continuous so we restrict the attention to such WFA. The decision problem 
of interest is then the following: 

Ap-WFA uniform CONTINUITY: 

Input: An average preserving WFA A over the binary alphabet S = {0, 1}. 

Question: Are both and everywhere continuous? 
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Note that the question is equivalent to asking about the uniform continuity of and 
(see Remark 1561) . 

To decide Ap-WFA uniform continuity we need to verify that is continuous and 
then check the condition (2) of Corollary [571 It turns out that, if A is ap and continuous, 
condition (2) is easy to test. 

Lemma 60. Let A be an average preserving WFA such that /_4 is continuous on S'^. Then 
condition (2) of Corollary 51_ is decidable for the function f^. 

Proof. As minimization is effective we can assume that the input automaton A is minimal 
and average preserving. First we can effectively check whether f^ = 0, in which case 
condition (2) of Corollary [571 is satisfied. Suppose than that 7^ 0. By Lemma [351 we can 
effectively transform the automaton to the form with transition matrices 



[Bo 









Bi 







bi 



where {Bq, Bi} is a stable set. Because is continuous on S'^ the condition (2) says that 
for all V eTj* 

fAivm = fAivon. 

From minimality we obtain that the sufficient and necessary condition for this to hold is 
that -Agi" = j4io"- 

Consider matrices AQik and AiQk. They are of the following forms: 

'BoB'i 



A, 



01*= 







1 



A 



10*= 



(BiBl 


bi + 5i(Eto'5S)bo^ 







Observe that 



k-l 



J2 B'o{E -Bo) = E- Bl and ^B\{E - Bi) = E - B\. 



i=0 



i=0 



As the set {Bq, Bi\ is stable, we must have , -S" and so all eigenvalues of both 
Bq and Bi must lie inside the unit disc. Thus the sums X^i^o -^0 ^"^^ Si^o -^1 converge. It 
follows that 

00 00 
Y,Bl = {E-Bo)-^ and = (i^; - 



i=0 

This means that we have the limits: 



j=0 



Aqiu. 

AlQu. 







bo + 5o(E-5i)-ibi 



and 







bi + 5i(E-5o)-ibc 
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So we are left with the simple task of checking the equality 



bo + Bo{E - 5i)-ibi = bi + Bi{E - Bo)-'ho. 

□ 

We are ready to prove the main result of this section. Recall that for A average preserv- 
ing, continuity of is computationally as hard as stability. We show that also simultaneous 
continuity of and /yi is as hard. 

Theorem 61. Decision problems Matrix Product Stability and Ap-WFA uniform 
CONTINUITY can be algorithmically reduced to each other. 

Proof. Suppose first that Matrix Product Stability is decidable, and let ^ be a given 
ap WFA over the binary alphabet. By Theorem |49] we can effectively determine if is 
continuous in S"^. If the answer is positive then - according to Lemma 1601- we can effectively 
check whether the function satisfies the condition (2) in Lemma 1571 By Lemma 1571 this is 
enough to determine whether /_4 is uniformly continuous, so we get the answer to Ap-WFA 

UNIFORM CONTINUITY. 

For the converse direction, let us assume that Ap-WFA uniform continuity is de- 
cidable. By Lemma HE] it is enough to show how we can determine if a given pair {Bo, Bi} 
of n X n matrices is stable. Because we can check whether lim = for i = 0, 1 (using 



the Lyapunov equation method as in IJ, page 169]), we can assume that {Bo} and {-Bi} 
are stable sets. 

In the following we effectively construct several ap WFA Aij over the binary alphabet 
such that 

• if {Bo, Bi} is stable then the functions /^j^ and /^-^ are continuous for each i,j, while 

• if {Bo,Bi} is not stable then for some i,j the function /^j^- is not continuous. 

The result then follows directly. The construction of Aij is similar to the proof of Theorem 
Again, we write down the transition matrices in the the block form 



An 



(Bo 


Co\ 




Do) 



A, 



only this time, instead of constant Dq = Di = 1, we use the 3x3 matrices 





(0 


1 


°^ 




^0 


-1 




^0= 1 





1 

2 










1 

2 






^0 





I) 




^0 








These matrices (with initial and final distributions / = (1,0,0) and F = (1/2,1/2,1)-^) 

form a minimal ap WFA T> that computes the continuous real function shown in Figure [HI 

An important feature of this function, implicit in the proof below, is the fact that it has 
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value zero at both endpoints of the domain interval. Also, by Theorem HOl {Dq,Di} is a 
continuous RCP set. 

Let i,j e {1, . . . n}. Denote by Cq the following n x 3 matrix: 

/O 0\ 


Cn = 10 


\0 oj 

where the single 1 is in the j-th row. Let Ci = —Co- 

We now construct the ap WFA Aij with transition matrices 



[Bo 






Do) 



A, 



initial distribution Jj (z-th element of the canonical basis) and final distribution F 
(0,..., 0,1/2, 1/2, If. 

Assume for a moment that f/i . is continuous. We show that then 

G = lim = (0, . . . , 0, 0, 1)'^, 
H = lim A^F= (0,..., 0,1,1)^. 



Consider only G; the case of H is similar. As {-Bo} is stable and {-Do} is RCP, an application 
of Lemma [36] on the singleton set {^o} shows that the limit G exists. The vector G is a 
1-eigenvector of Aq and by direct computation we obtain that the last three elements of G 
are 0, 0, 1. 

Notice now that the vector G' = (0, . . . , 0, 1)"^ is a 1-eigenvector of Aq. Were G ^ G', we 
would have the 1-eigenvector G — G' whose last three elements are zero. But then the first 
n elements of G — G" form a 1-eigenvector of -Bq and so {-Bq} is not stable, a contradiction. 
Thus G = G'. The proof that H = (0, . . . , 0, 1, 1)"^ is analogous. 

We are now ready to finish the proof. Assume first that {-Bo,-Bi} is a stable set. We 
claim that then f^.^ , /_4.^. are both continuous. Now the general form of Lemma [SS] comes 
into play: According to part (3) of that Lemma, the set {Aq, Ai} is a continuous RCP set 
and so, by Theorem HQl the function /^^^ is continuous. 

By Corollary [571 we only need to show that condition (2) of that Corollary is satisfied. 
We can compute the limits 



lim AiA'^F 



AiG 



/0\ 



1 

1 

2 

VJ 



AoH = lim AqA'IF. 



This implies that f_A.^{v01'^) = /^^^(flO'^) for all f G S*, so by Corollary [571 the function 
f/i . . is continuous. 

Suppose then that the set {Bq, Bi} is not stable. Then there exist i,j and w G S"^ such 
that for some e > there are infinitely many n such that \{Bpref„{w))i,j\ > £■ Consider the 
automaton Aij for these We want to prove that f^.. is not continuous in this case. 

We will proceed by contradiction, assuming that f^.. is continuous. Then Aij is uniformly 
convergent by Lemma [2TJ Then from Lemma [23 and continuity of /_4- we obtain that 



lim [2FA,^ipreUw)0) - /a, (pre/„(w7)10-) - /a, (pre/„(^i;)0-)] = 0. 

This means that lim IApref,Jw){'^AoF — AiG — G) = 0. However, a straightforward 
calculation shows that the vector 2AqF — AiG — G is the j-th element of the canonical 
basis and so IApref„{w){2AQF — AiG — G) = (Apre/„(«)))j,i which does not converge to zero. 
Therefore, can not be continuous. □ 

Remark 62. Analogously to Remark [48] we can note that in the case that Matrix Prod- 
uct Stability is undecidable we have in fact showed the recursive inseparability of ap 
WFA whose and /_4 are both continuous from those ap WFA whose is not continuous. 

4.-3. Constructing WFA defining continuous real functions 

We end our paper by giving a few notes on how to construct nontrivial ap WFA with 

continuous and for all initial distributions. 
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Lemma 63. Let A be a left-minimal ap automaton. Then the following statements are 
equivalent: 

(1) fji, is constant 

(2) F4 is constant 

(3) AaF = F for all a e S. 

Proof. Implications (3) =^ (2) =^ (1) are obvious. We prove (1) =^ (2) and (2) =^ (3). 

Assume (1): fA^w) = a for all w G S"^. Then f^, is the u;-function corresponding to both 
-F4 and the constant word function G{u) = c. Then F4 — G is an average preserving word 
function whose w-function is zero, so by Lemma fT5l we have -F4 — G = 0, i.e. condition (2) 
holds. 

To prove (3), assuming (2), we note that for all m G S* and a G S the equality 

lA^AaF = F^iua) = F^iu) = lA^F 
holds. By left minimality this implies AaF = F. □ 

Notice that even without left-minimality we have the following: if A is an ap WFA such 
that AaF 7^ F for some a G S then there exists a choice for the initial distribution I such 
that is not constant. 

Lemma 64. Let {Bq, Bi} be a stable set of matrices. Then det(i?o + Bi — 2E) 7^ 0. 

Proof. Were it not the case, there would exist a vector v ^ such that for each n we would 
have 

^ Bq + Bi 

Then we can write: 



< E^wi- 

However, by Lemma [2] there exists n such that ||-Bu;|| < 1 for each w of length n. For such 

a contradiction. □ 

The following theorem (and its proof) gives us tools to generate ap WFA with non- 
constant, continuous f^ and We know from Corollary \^ that we can limit the search to 
ap WFA with transition matrices in the form i^, for stable {Bq, Bi}. The minimality con- 
dition can be replaced by the weaker concept that all initial distribution yield a continuous 
WFA. 
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1^11 



Bo + B^ 



BwV 
2" 



Theorem 65. Let {Bo,Bi} be a stable set of matrices. Consider the problem of finding 
vectors bo, bi and a final distribution F so that, for any choice of the initial distribution I, 
the transition matrices 



A,. 



B, 







0,1, 



describe an ap WFA A with continuous fjs, and f^. We also want AqF ^ F , so that for 
some initial distribution A does not define the constant function. 

(1) //det(-Bo + Bi — E) = then we can algorithmically find such vectors ho, bi and F. 

(2) //det(-Bo + Bi — E) ^ Q then such choices do not exist: only the constant function f^ 
can be obtained. 

Proof. We are going to obtain sufficient and necessary conditions for the vectors bo, bi and 
F. 

By definition, the ap condition is {Aq + Ai)F = 2F. Let F' be the vector obtained from 
F by removing the last element. Note that the last element of F cannot be zero, because 
then the ap condition would require (-Bo + Bi)F' = 2F', which only has the solution F' = 
by Lemma EH Without loss of generality, we fix the last element of F to be 1. (We can do 
this because multiplication of the final distribution by any non-zero constant c has only the 
effect of multiplying /_4 and by c.) 

The ap condition becomes 



(Bo + 5i 


bo + bA 


V 


2 J 



F' 
1 



F' 



that is, 

(So + fii - 2E)F' + bo + bi = 0. (6) 

From Lemma EU we have that Bq + Bi — 2E is regular. This means that for any choice of 
vectors bo, bi there is a unique F', given by ([6]), that makes the WFA average preserving. 

The requirement that is continuous is automatically satisfied as {Bq,Bi} is stable 
(the case (3) of Lemma [HUl and the case (2) of Theorem HO]). By Corollary [FTl continuity of 
fj[ is then equivalent to the condition /^^(f 10"^) = /yt(f 01'^) for all v G S*. Since we require 

to be continuous for all initial distributions, we have the equivalent condition that 

lim {AoA'l)F = lim {AiA'^)F. 

fc— »oo fc^oo 

As in the proof of Lemma EOl we obtain 



Aqiu 

AlQu. 







bo + 5o(E-5i)-ibi 



h, + B,{E - Bo)-'h, 
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and 



Therefore, we can rewrite AqiujF = AiqujF as an equation for vectors bo and bi: 

bo + BoiE - fii)-^bi = bi + Bi{E - Boy'ho. 

This can be written equivalently as 

{Bo + fii - E)[{E - fii)-^bi -{E- Bo)-'ho] = (7) 

So choices of bo, bi and F that satisfy the requirements of the theorem (except for AqF ^ F) 
are exactly the ones that satisfy (EI) and 

Consider now the final requirement AqF ^ F. This is equivalent to 

{Bo - E)F' + bo ^ 0, 

and further to F' ^ —{Bo — E)~^ho. Substituting for F' in the ap condition ([6]), and recalling 
that matrix Bo + Bi — 2E is regular, we obtain the equivalent condition 

-bo - {B, - E){Bo - E)-^ho + bo + bi ^ 0, 

which can be rewritten as 

{E - fii)-ibi -{E- So)-^bo ^ 0. (8) 

We have obtained sufficient and necessary conditions (EI), ^ and 

Now we can prove parts (1) and (2) of the theorem. If det(i?o + Bi — E) ^ Q then ([7]) and 
([H]) are contradictory, so no choice of bo, bi and F can satisfy all the requirements. On the 
other hand, if det{Bo + Bi— E) = we can choose bo, bi so that — -Bi)~^bi — (.E — _Bo)~^bo 
is a nonzero element of the kernel of matrix Bo + Bi — E. This can be easily done by, for 
example, choosing any nonzero k G ker{Bo + Bi — E) and an arbitrary vector bo, and setting 

h, = {E-B^) [k+{E-Bo)-'ho]. 

These choices of bo and bi satisfy ([7]) and (IE]). We can then calculate the unique F' that 
satisfies Qj. □ 

We see that in order to generate non-constant functions we need a stable pair of matrices 
{Bo, Bi} such that det(5o + B^ ~ E) = 0. 

The following numerical example illustrates the previous proof. 

Example 66. Let 

V33/ V33/ 

It is easy to see that {Bo, Bi} is stable and det{Bo + Bi—E) =0. The kernel of Bo + Bi — E 
is generated by (1, 0)"^. If we (arbitrarily) choose k = (9, 0)"'" and bo = (3, 0)^ we can solve 

h, = {E- Bi) [k+{E- Bo)-'ho] = (5, 6)^. 
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Figure 9: The continuous function specified by the ap WFA in Example [ 



From 



we get 



F' = -{Bo + B,- 2Ey\ho + bi) = (10, 6)^ 



So we have the ap WFA 



1 1 



An 



i i 

3 3^ 
1 



I 5 

-I 1 6 
1 




which with the initial distribution (1, 0, 0) defines the real function /_4 whose graph is shown 
in Figure M 

Example 67. It is easy to see that one-state continuous ap WFA can compute precisely all 
constant functions. 

Let us find all two-state ap WFA with continuous and Now Bq and Bi are 
numbers, and the condition that det{Bo + Bi — E) = forces them to add up to one. 
Stability requires both numbers to be less than 1 in absolute value, so we have Bq = a 
and Bi = 1 — a for some < a < 1. We can choose Bq and bi arbitrarily, and calculate 
F' = bo + bi. We get the continuous ap WFA with 



Ao 



a bo 
1 



1 — a bi 

1 
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bo + bi 
1 



for < a < 1 and bo,bi G M. Note that we did not require (Ej) to hold, which means that 
we also get the constant functions when 

bi _ bp 
a 1 — a 



5. Conclusions 

We have investigated the relationship between continuity of WFA and properties of its 
transition matrices. We have obtained a "canonical form" for ap WFA computing continuous 
functions (the form from Lemma . These results generalize some of the theorems 
in l3| and are similar to those obtained in a slightly different setting in the article H . 
Moreover, we present a method of constructing continuous WFA. 

We have also asked questions about decidability of various incarnations of the continuity 
problem. Mostly, these problems turn out to be equivalent to the Matrix Product Stability 
problem. This is why we believe that any interesting question about continuity of functions 
computed by WFA is at least as hard as Matrix Product Stability. 

There are numerous open questions in this area. Most obviously, settling the decidability 
of the Matrix Product Stability problem would be a great step forward. However, as this 
problem has resisted efforts of mathematicians so far, we offer a few other open problems: 



Open Question 68. Given an automaton computing a continuous cu-function, can we al- 
gorithmically find the ap automaton computing the same function? 

Open Question 69. Given ap automaton computing cj-function which is uniformly con- 
tinuous on Q, can we algorithmically find automaton computing the function g from Theo- 
rem [18P 



Open Question 70. Is deciding the continuity of for ap automata computationally 
equivalent with deciding Matrix Product Stability? 

Other interesting questions that can be posed on WFA are whether a given /_4 converges 



everywhere, and whether it is bounded. We know that all level WFA (as described in 10|) are 
both everywhere convergent and bounded but both properties remain to be characterized in 
the general case. We also point out that similar results on higher differentiability classes (e.g. 
continuously differentiable WFA functions) are likely to exist and should be investigated. 
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